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DETAILED ACTION 
Response to Arguments 

On pages 11-15, applicant argues that Maeda does not teach that a modified 
video sequence is obtained without editing each frame of the original video sequence. 
While the applicant's points are understood, the examiner respectfully disagrees. See 
for example Maeda figure 8, and column 11, lines 20-25. There Maeda discloses 
extracting a main object and its shade from the original image. The examiner notes that 
after this initial extraction, the main object is separated from the background portion of 
the image. Maeda further discloses in column 13, lines 17-22, performing a 
modification on the object such as an enlargement or rotation. Maeda then discloses in 
column 14, lines 27-37, synthesizing the main object with the background. Therefore, 
only the frames corresponding to the main object have been modified/edited. The 
frames corresponding to the background remain unchanged, thus resulting in a modified 
sequence obtained without editing each frame of the original sequence. Therefore the 
rejection has been maintained. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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Claims 1-2, 22, 25-27, and 29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Maeda (6625316) in view of Burt et al. (6393163), (hereinafter 
referred to as "Burt"). 

Regarding claims 1, 25-27, and 29, Maeda discloses an apparatus that 
relates to extracting an object from an image and processing the extracted image 
(Maeda: column 1, lines 8-11). This apparatus comprises "editing at least one or 
more original camera motion layers to obtain modified camera motion layers 
such that each from of a video sequence composed from the modified camera 
motion layers and the original fixed frame layers is obtained without editing each 
from of the original sequence" (Maeda: column 13, lines 15-28, wherein the 
original camera motion layers is the background, the editing is the process of 
modifying the input, and the modified layer is the background after the editing 
has occurred). Although Maeda fails to show the modified camera motion layer 
corresponding to an original camera motion layer having a substantially non- 
stationary component as claimed, Maeda does show modifying a camera motion 
layer corresponding to an original camera-motion layer (Maeda: figure 8, column 
10, lines 55-65, wherein the camera motion layer is the background captured by 
items 202 and 207. The examiner notes that since the background is a motion 
image, the substantially non-stationary component is the motion image described 
having little motion). However, Maeda fails to disclose the camera motion layer 
being a layer having an appearance of moving along with the camera as the 
camera moves. Burt teaches that image processing systems process images in 
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an inefficient individual manner (Burt: column 1 , lines 24-26). To help alleviate 
this problem, Burt discloses "the camera motion layer being a layer that appears 
to move with the camera as the camera moves" (Burt: figure 9, wherein the 
background appears to move as the camera is moving). Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was 
made to take the apparatus disclosed by Maeda and add the processing taught 
by Burt in order to obtain an apparatus that can process a plurality of images at 
the same time. 

Regarding claims 2 and 22, Maeda discloses "converting one of the 
original camera motion layers to an original image" (Maeda: column 13, tines 15- 
28, wherein the converting is the decoding to obtain an image), "editing to obtain 
a modified image" (Maeda: column 13, lines 15-28, wherein the editing is the 
process of modifying the input), and "converting the modified image to one of the 
modified camera motion layers" (Maeda: column 14, lines 38-40, wherein the 
modified image is converted or synthesized with the rest of the layers). 
Claims 3-5 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Maeda (6625316) in view of Burt et al. (6393163), (hereinafter referred to as "Burt") 
in further view of Jasinschi et al. (6504569), (hereinafter referred to as "Jasinschi"). 

Regarding claims 3 and 23, note the examiners rejection for claim 1, and 
in addition, claims 3 and 23 differ from claim 1 in that claims 3 and 23 further 
require rectifying the original and modified image prior to editing and converting 
the image. Jasinschi teaches that it is well known in the art to rectify an image 
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before manipulating the object (Jasinschi: column 1, lines 20-31, wherein the 
rectifying is projecting the images on different planes). Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was 
made to implement the image rectifying taught by Jasinschi in order to obtain an 
apparatus that edits an object correctly by first placing the object in the correct 
perspective. 

Regarding claims 4 and 5, Maeda discloses "inserting, deleting, or 
changing a portion to obtain modified camera motion layers" (Maeda: column 13, 
lines 15-28, wherein the changing is the enlargement or reduction which then 
replaces the camera motion layer). 

Claims 6, 13, and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Maeda (6625316) in view of Burt et al. (6393163), (hereinafter referred to as "Burt") 
in further view of Foreman et al. (6628303), (hereinafter referred to as "Foreman"). 

Regarding claims 6 and 15, note the examiners rejection for claim 1 , and 
in addition, claims 6 and 15 differ from claim 1 in that claims 6 and 15 further 
require adding a video sequence to the original camera motion layers. Foreman 
teaches that prior art video processing systems are very complex utilizing 
multiple windows for controlling parameters of video (Foreman: column 1, lines 
39-41). To help alleviate this problem, Foreman discloses a single interface 
wherein a user can "add a video sequence to one of the original camera motion 
layers" (Foreman: figure 8, column 9, lines 61-62, wherein the video sequence is 
the shots). Therefore, it would have been obvious to one having ordinary skill in 
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. the art at the time the invention was made to implement the editing system taught 
by Foreman in order to obtain an apparatus that is easy to use by all users. 

Regarding claim 1 3, Foreman discloses "modifying an order of one of the 
original camera motion layers" (Foreman: figure 8, column 9, lines 61-67, 
wherein modifying the order is modifying the order in which the video is inserted). 
Claims 7-12, 14, 16-21, 24, 28, and 30-33 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Maeda (6625316) in view of Burt et al. (6393163), 
(hereinafter referred to as "Burt") in further view of Petelycky et al. (6204840), 
(hereinafter referred to as "Petelycky"). 

Regarding claim 7, note the examiners rejection for claim 1, and in 
addition, claim 7 differs from claim 1 in that claim 7 further requires adding an 
animation sequence to one of the original camera motion layers. Petelycky 
teaches that prior art video editing systems are difficult to learn and use 
(Petelycky: column 1, lines 39-44). To help alleviate this problem, Petelycky 
discloses an apparatus that provides an interface that allows the user to "add 
animation sequences to one of the original camera motion layers" (Petelycky: 
figure 3E, column 15, lines 1-28). Therefore, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to implement 
the editing system taught by Petelycky in order to obtain an apparatus that is 
easy to learn and use. 

Regarding claims 8-9, although not disclosed, it would have been obvious 
to add a 3-D object or user-activated region to one of the camera motion layers 
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(Official Notice). Doing so would have been obvious in order to make the video 
more appealing to the user. 

Regarding claim 10, Petelycky discloses "modifying an on/off time of one 
of the original camera motion layers" (Petelycky: figure 3B, wherein the on/off 
time is modified by use of the sliders). 

Regarding claim 11, Petelycky discloses "modifying an opaqueness of one 
of the original camera motion layers" (Petelycky: figure 3E, wherein the 
opaqueness is modified using the transparent slider). 

Regarding claim 12, Petelycky discloses "modifying fade-in/fade-out of 
one of the original camera motion layers" (Petelycky: figure 3F, items 364-365). 

Regarding claim 14, Petelycky discloses "deleting one of the original 
camera motion layers" (Petelycky: column 1 1 , lines 53-54). 

Regarding claim 16, Petelycky discloses "modifying a size of one of the 
original camera motion layers" (Petelycky: figure 3E, wherein the size is modified 
by the size slider). 

Regarding claims 17-19 and 24, Maeda discloses "editing camera motion 
parameters of one of the original camera motion layers" (Maeda: column 13, 
lines 15-25, wherein the camera motion parameters are described by the affine 
transformation, which is based on analytical calculations for both the foreground 
and background objects). 

Regarding claim 20, Maeda discloses "replacing the camera motion 
parameters with camera motion parameters from another video sequence" 
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(Maeda: column 13, lines 15-25, column 14, lines 38-44, wherein replacing is 
the synthesizing different objects from different source layers which all have 
different camera motion parameters or affine transformations). 

Regarding claims 21 and 28, Maeda discloses "editing at least one of the 
fixed-frame layers" (Maeda: figure 15, wherein the cattle is the fixed frame layer 
or foreground object). 

Regarding claim 30, note the examiners rejection for claims 1 and 17. 

Regarding claims 31-32, although not disclosed, it would have been 
obvious to specify a coordinate transformation between image planes (Official 
Notice). Doing so would have been obvious in order to correctly display the 
images to a user. 

Regarding claim 33, Burt discloses "the camera movement includes 
panning" (Burt: column 17, lines 8-10). 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dave Czekaj whose telephone number is (571) 272- 
7327. The examiner can normally be reached on Mon-Thurs and every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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